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DETAILED ACTION 

Specification 

1 . Applicant is reminded of the proper language and format for an abstract of the 
disclosure. 

The abstract should be in narrative form and generally limited to a single 
paragraph on a separate sheet within the range of 50 to 1 50 words. It is important that 
the abstract not exceed 150 words in length since the space provided for the abstract 
on the computer tape used by the printer is limited. The form and legal phraseology 
often used in patent claims, such as "means" and "said," should be avoided. The 
abstract should describe the disclosure sufficiently to assist readers in deciding whether 
there is a need for consulting the full patent text for details. 

The language should be clear and concise and should not repeat information 
given in the title. It should avoid using phrases which can be implied, such as t "The 
disclosure concerns," "The disclosure defined by this invention/' "The disclosure 
describes," etc. 



2. Claim 20 is objected to because of the following informalities: 

Claim 20 is dependent on itself. The examiner will interpret Claim 20 to 
depend on Claim 19. Appropriate correction is required. 



Claim Rejections - 35 USC § 102 

1 . The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 
A person shall be entitled to a patent unless - 

(e) the invention was described in a patent granted on an application for patent by another filed in the 
United States before the invention thereof by the applicant for patent, or on an international application 
by another who has fulfilled the requirements of paragraphs (1), (2), and (4) of section 371(c) of this 
title before the invention thereof by the applicant for patent. 
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The changes made to 35 U.S.C. 102(e) by the American Inventors Protection Act 
of 1999 (AIPA) and the Intellectual Property and High Technology Technical 
Amendments Act of 2002 do not apply when the reference is a U.S. patent resulting 
directly or indirectly from an international application filed before November 29, 2000. 
Therefore, the prior art date of the reference is determined under 35 U.S.C. 102(e) prior 
to the amendment by the AIPA (pre-AlPA 35 U.S.C. 102(e)). 

2. Claims 1, 6, 7, 15, 19, 20, 23 and 29 are rejected under 35 U.S.C. 102(e) as 
being anticipated by Wang (US 6,781,626). 

Regarding Claim 1 , Wang teaches determining, for the pixel, a first edge- 
orientation of a first color and a second edge-orientation of a second color (col. 7, lines 
18+-30). Wang further teaches determining an interpolation direction D(i, j) for pixel 
locations. In order to determine whether the pixels is in the horizontal or vertical 
direction, the local intensity gradient at the location (i, j) and a continuity bias 
representative of an intensity is determined. Wang further states that the local intensity 
gradient may determine the interpolation direction unless the continuity trend in the 
neighborhood about the pixel location (i, j) suggests otherwise (col. 8, lines 12-23). This 
teaches that both the local intensity gradient and the continuity bias representative must 
both indicate positive results for a specific interpolation direction. This is interpreted as 
providing respective interpolation votes associated with the first-edge orientation and 
the second edge-orientation to determine a selected interpolation orientation, such that 
the respective interpolation votes being either a first interpolation orientation (horizontal) 
or a second interpolation orientation (vertical). The limitation of the selected 
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interpolation orientation being based on the number of the interpolation votes for the 
first interpolation orientation and the second interpolation orientation is interpreted as 
both the local intensity gradient (being one vote) and the continuity bias representative 
(another vote) both agreeing that the pixel is in same interpolation orientation. 

Regarding Claim 6, Wang teaches receiving a set of first color values (red or blue 
also referred to as chrominance) and a set of second color values (green also referred 
to al luminance; col. 7, lines 25-34), determining for a given one of the first color values 
associated with a given one of the pixel locations a first degree of change using the set 
of first color values and a second degree of change using the set of second color values 
(a continuity measure C(i j) is determined at each pixel location for green, red and blue 
values for determining the degree of continuity in the horizontal and vertical directions; 
col. 7, lines 45+), the first and second degrees of change each having a row component 
and a column component (horizontal and vertical). Wang further teaches comparing 
the row component to the column component for both the first and second degrees of 
change to determine a selected interpolation orientation (col. 8, lines 12+). 

Regarding Claim 7, Wang teaches interpolating the missing second color value 
associated with the given pixel location using the selected interpolation orientation (see 
figure 7, steps 908-924). 

Claim 15 is analyzed and discussed with respect to Claim 6. (See rejection of 
Claim 6 above.) 

Claim 19 is analyzed and discussed with respect to Claim 6. (See rejection of 
Claim 6 above.) 
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Claim 20 is analyzed and discussed with respect to Claim 7. (See rejection of 
Claim 7 above.) 

Claim 23 is analyzed and discussed with respect to Claim 6. The set of third 
color values are red or blue in which processing is performed on the third set the same 
as with the first and second sets. (See rejection of Claim 6 above.) 

Claim 29 is analyzed and discussed with respect to Claim 15. (See rejection of 
Claim 15 above.) 

Claim Rejections - 35 USC § 103 

3. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

4. Claim 2 is rejected under 35 U.S.C. 103(a) as being unpatentable over Wang in 
view of Shinohara et al article "Color Image Analysis in a Vector Field". 

Regarding Claim 2, Wang fails to specifically teach the first and second-edge 
orientations are first and second gradients, respectively, the first and second gradients 
forming a Jacobian of the pixel. However the Shinohara et al article teaches using the 
Jacobian matrix in edge detection for determining vector gradient magnitude (see 
abstract). Shinohara et al further teaches that by using the Jacobian matrix, edges are 
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more accurate and finer than the edges obtained by other methods. Using Jacpbian 
matrix is advantageous in the system of Wang for creating defined edges in which 
interpolation orientation can be determined. Therefore, it would have been obvious to 
one having ordinary skill in the art to have a first and second gradients forming a 
Jacobian of the pixel for the purpose of creating accurate edge orientation. 



Allowable Subject Matter 
5. Claims 3-5, 8-14,>7-J9, 21-22, 24-28, and 30-33 are objected to as being 
dependent upon a rejected base claim, but would be allowable if rewritten in 
independent form including all of the limitations of the base claim and any 
intervening claims. 

Regarding Claim 3, the prior art neither teaches nor fairly suggests a method for 
determining whether a pixel lies on an edge of a digital image, said method comprising: 
determining, for said pixel, a first edge-orientation of a first color and a second edge- 
orientation of a second color; and providing respective interpolation votes associated 
with said first edge-orientation and said second edge-orientation to determine a 
selected interpolation orientation, said respective interpolation votes being either a first 
interpolation orientation or a second interpolation orientation, said selected interpolation 
orientation being based on the number of said interpolation votes for said first 
interpolation orientation and said second interpolation orientation, wherein said first and 
second edge-orientations are first and second gradients, respectively, said first and 
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second gradients forming a Jacobian of said pixel, wherein said first interpolation 
orientation is a horizontal interpolation and said second interpolation orientation 
is a vertical interpolation, and wherein said step of providing further comprises: 
setting a first one of said interpolation votes associated with said first gradient, 
said first interpolation vote being set as said horizontal interpolation when the 
absolute value of a row component of said first gradient is lower than the 
absolute value of .alpha, column component of said first gradient, said first 
interpolation vote being set as said vertical interpolation when the absolute value 
of said column component of said first gradient is lower than the absolute value 
of said row component of said first gradient; setting a second one of said 
interpolation votes associated with said second gradient, said second 
interpolation vote being set as said horizontal interpolation when the absolute 
value of .alpha, row component of said second gradient is lower than the 
absolute value of a column component of said second gradient, said second 
interpolation vote being set as said vertical interpolation when the absolute value 
of said column component of said second gradient is lower than the absolute 
value of said row component of said second gradient; and selecting either said 
horizontal interpolation, said vertical interpolation or a combination of said 
vertical interpolation and said horizontal interpolation for said selected 
interpolation orientation based on said steps of setting. 

Regarding Claim 8 f the prior art neither teaches nor fairly suggests a method for 
demosaicing a digital image represented as values at pixel locations, said method 
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comprising: receiving a set of first color values and a set of said second color values; 
determining for a given one of said first color values associated with a given one of said 
pixel locations a first degree of change using said set of first color values and a second 
degree of change using said set of second color values, said first and second degrees 
of change each having a row component and a column component; comparing said row 
component to said column component for both said first and second degrees of change 
to determine a selected interpolation orientation, interpolating a missing second color 
value associated with said given pixel location using said selected interpolation 
orientation, and further comprising interpolating said missing second color value by 
applying a linear prediction function that uses said first color values and said 
second color values. 

Regarding Claim 10, the prior art neither teaches nor fairly suggests a method for 
demosaicing a digital image represented as values at pixel locations, said method 
comprising: receiving a set of first color values and a set of said second color values; 
determining for a given one of said first color values associated with a given one of said 
pixel locations a first degree of change using said set of first color values and a second 
degree of change using said set of second color values, said first and second degrees 
of change each having a row component and a column component; comparing said row 
component to said column component for both said first and second degrees of change 
to determine a selected interpolation orientation, interpolating a missing second color 
value associated with said given pixel location using said selected interpolation 
orientation, and further comprising determining a difference value by subtracting 
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said interpolated missing second color value from said given first color value; 
and interpolating a missing first color value using at least said difference value, 
said missing first color value being associated with one of said pixel locations 
that did not produce said first color value. 

Regarding Claim 1 1 , the prior art neither teaches nor fairly suggests a method for 
demosaicing a digital image represented as values at pixel locations, said method 
comprising: receiving a set of first color values and a set of said second color values; 
determining for a given one of said first color values associated with a given one of said 
pixel locations a first degree of change using said set of first color values and a second 
degree of change using said set of second color values, said first and second degrees 
of change each having a row component and a column component; comparing said row 
component to said column component for both said first and second degrees of change 
to determine a selected interpolation orientation, and wherein said first and second 
degrees of change are first and second gradients, respectively, said first and second 
gradients forming a Jacobian of said given first color value, and wherein said step of 
comparing further comprises: supplying, by each of said first and second 
gradients, a respective interpolation vote, said interpolation vote being either a 
first interpolation orientation or a second interpolation orientation, said selected 
interpolation orientation being based on the number of said interpolation votes 
for said first interpolation orientation and said second interpolation orientation. 

Regarding Claim 16, the prior art neither teaches nor fairly suggests a method for 
demosaicing a digital image represented as values at pixel locations, said method 
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comprising: receiving a set of first color values and a set of said second color values; 
determining for a given one of said first color values associated with a given one of said 
pixel locations a first degree of change using said set of first color values and a second 
degree of change using said set of second color values, said first and second degrees 
of change each having a row component and a column component; comparing said row 
component to said column component for both said first and second degrees of change 
to determine a selected interpolation orientation, wherein said first color values are 
chrominance color values and said second color values are luminance color values, 
further comprising: determining a first mean luminance value of .alpha, first group 
of said luminance color values and a second mean luminance value of .alpha, 
second group of said luminance color values; determining a difference 
percentage between said first mean luminance value and said second mean 
luminance value; and increasing said luminance color values of said first group 
by said difference percentage when said first mean luminance value is lower than 
said second mean luminance value. 

Regarding Claim 1 7, the prior art neither teaches nor fairly suggests a method for 
demosaicing a digital image represented as values at pixel locations, said method 
comprising: receiving a set of first color values and a set of said second color values; 
determining for a given one of said first color values associated with a given one of said 
pixel locations a first degree of change using said set of first color values and a second 
degree of change using said set of second color values, said first and second degrees 
of change each having a row component and a column component; comparing said row 
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component to said column component for both said first and second degrees of change 
to determine a selected interpolation orientation, wherein said first color values are 
chrominance color values and said second color values are luminance color values, 
further comprising: determining a Jacobian of a given one of said luminance color 
values from said set of luminance color values; determining a first sum of the 
absolute values of the values within said Jacobian; and if said first sum is less 
than a predefined threshold: multiplying said given luminance color value by 
four, adding said luminance color values of four diagonally adjacent pixel 
locations to obtain a second sum, and dividing said second sum by eight. 

Regarding Claim 18, the prior art neither teaches nor fairly suggests a method for 
demosaicing a digital image represented as values at pixel locations, said method 
comprising: receiving a set of first color values and a set of said second color values; 
determining for a given one of said first color values associated with a given one of said 
pixel locations a first degree of change using said set of first color values and a second 
degree of change using said set of second color values, said first and second degrees 
of change each having a row component and a column component; comparing said row 
component to said column component for both said first and second degrees of change 
to determine a selected interpolation orientation, further comprising: determining a 
Jacobian of said given first color value; determining a first sum of the absolute 
values of the values within said Jacobian; and if said first sum is less than a 
predefined threshold: multiplying said given first color value by eight, adding 
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said first color values of eight nearest pixel locations to obtain a second sum, 
and dividing said second sum by sixteen. 

Claim 21 is substantially similar to Claim 8. 

Regarding Claim 24, the prior art neither teaches nor fairly suggests a digital 
image system for demosaicing a digital image represented as values at pixel locations, 
said system comprising: a processor adapted to receive a set of first color values and a 
set of second color values, said processor being further adapted to determine for a 
given one of said first color values associated with a given one of said pixel locations a 
first degree of change using said set of first color values and a second degree of 
change using said set of second color values, said first and second degrees of change 
each having a row component and a column component, said row component being 
compared to said column component for both said first and second degrees of change 
to determine a selected interpolation orientation, wherein said processor is further 
adapted to interpolate a missing second color value for said pixel location associated 
with said given pixel location using said selected interpolation orientation, wherein said 
processor is further adapted to receive a set of third color values, said sets of first, 
second and third color values each being associated with a different color, said 
processor further being capable of determining a third degree of change associated with 
said third color values, and wherein said processor is further adapted to determine a 
difference value by subtracting said interpolated missing second color value from 
said given first color value and interpolate a missing first color value for said 
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pixel location associated with said second or third color values using at least 
said difference value. 

Regarding Claim 25, the prior art neither teaches nor fairly suggests a digital 
image system for demosaicing a digital image represented as values at pixel locations, 
said system comprising: a processor adapted to receive a set of first color values and a 
set of second color values, said processor being further adapted to determine for a 
given one of said first color values associated with a given one of said pixel locations a 
first degree of change using said set of first color values and a second degree of 
change using said set of second color values, said first and second degrees of change 
each having a row component and a column component, said row component being 
compared to said column component for both said first and second degrees of change 
to determine a selected interpolation orientation, wherein said processor is further 
adapted to interpolate a missing second color value for said pixel location associated 
with said given pixel location using said selected interpolation orientation, wherein said 
processor is further adapted to receive a set of third color values, said sets of first, 
second and third color values each being associated with a different color, said 
processor further being capable of determining a third degree of change associated with 
said third color values, and wherein said first, second and third degrees of change 
are first, second and third gradients, respectively, said first, second and third 
gradients forming a Jacobian of said given first color value, each of said first, 
second and third gradients supplying a respective interpolation vote, said 
interpolation vote being either a first interpolation orientation or a second 



Application/Control Number: 09/940,825 Page 14 

Art Unit: 2612 

interpolation orientation, said selected interpolation orientation being based on 
the number of said interpolation votes for said first interpolation orientation and 
said second interpolation orientation. 

Claims 30, 31, and 33 are substantially similar to Claims 16-18. 

Regarding Claim 32, the prior art neither teaches nor fairly suggests a 
digital image system for demosaicing a digital image represented as values at pixel 
locations, said system comprising: a processor adapted to receive a set of first color 
values and a set of second color values, said processor being further adapted to 
determine for a given one of said first color values associated with a given one of said 
pixel locations a first degree of change using said set of first color values and a second 
degree of change using said set of second color values, said first and second degrees 
of change each having a row component and a column component, said row 
component being compared to said column component for both said first and second 
degrees of change to determine a selected interpolation orientation, wherein said 
processor is further adapted to determine a Laplacian of a select color value 
within either said set of first color values or said set of second color values and 
add said Laplacian multiplied by an adjustable parameter to said select color 
value. 

Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Jacqueline Wilson whose telephone number is (703) 
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308-5080. The examiner can normally be reached on 8:30am-5:00pm (alternate 
Fridays off). 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Wendy Garber can be reached on (703) 305-4929. The fax phone number 
for the organization where this application or proceeding is assigned is 703-872-9306. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 



JW 

11/26/04 




